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Consider  the  following  ainplifisd  nodal  of  a  clineial  trial.  Pationta  arrive  se¬ 
quentially  at  a  treatment  cantor  and  receive  ona  of  two  treatments:  A  or  B.  The 
(immediate  response  of  the  1th  patient  to  receive  treatment  A  is  i  -  1,2,..., 

mV  * 

that  of  the  j  patient  to  receive  treatment  B  is  y^,  J  •  1,2,...  .  At  any  stage 

of  the  process,  having  observed  x. . .  y, ,...,y  ,  the  experimenter  can  stop  the 

experiment  and  declare  (1)  A  is  the  better  treatment,  (2)  B  is  better,  or  (3)  there 
is  essentially  no  difference  between  A  and  B;  or  he  can  continued  the  experiment 
and  assign  the  next  patient  to  treatment  A  or  B  according  to  sons  allocation  rule. 
In  this  paper  ve  shall  be  primarily  Interested  in  the  experimenter's  allocation  rule, 
which  should  be  selected  insofar  as  possible  (1)  to  permit  valid  inferences  upon  ter¬ 
mination  of  the  experiment  and  (11)  to  minimise  in  some  sense  the  number  of  patients 
receiving  the  inferior  treatment  during  the  course  of  the  experiment. 

The  specific  mathematical  framework  developed  below  to  discuss  this  problem  was 
introduced  by  Flehinger,  Louis,  Robbins,  and  Singer  (1972)  and  developed  by  Robbins  end 
Slegnund  (1973),  Louis  (1975),  and  Hayre  (1979).  To  a  considerable  extent  the  present 
paper  is  a  review  and  exposition  of  these  ideas.  An  interesting  and  somewhat  different 
approach  has  been  recently  developed  by  Bather  (1980,  1981),  and  it  would  be  interest¬ 
ing  to  make  a  systematic  comparison  of  Bather's  approach  with  that  outlined  below. 

Ve  assume  that  x^,...,xa,...  are  Independent  ftfti^.l)  and  y^,...,yn,...  are 
Independent  n(v2,l)  random  variables ,  and  that  the  x's  and  y's  are  independent. 
For  an  indication  how  the  results  given  here  can  be  extended  via  large  sample  approxi¬ 
mations  to  non-normal  data,  see  Robbins  (1974).  Lot  8  "  y^  -  U2 ,  *>d  to  be  specific 
aesi—  that  the  better  treatment  is  that  yielding  the  larger  mean  response,  tame  to 
say  that  treatment  A  is  superior  to  say  that  8  >  0,  etc. 

Let  x^  -  sf1  £,x  xt,  yft  -  n_l  yjt  and  s^  -  (^  -  y_)  •  Having 

observed  xlt...,xa.  and  y1,...,yB,  the  natural  estimator  of  8  is 
Since  problems  of  statistical  inference  about  8  are  invariant  under  changes  la  lo¬ 
cation  of  the  data,  it  is  reasonable  to  consider  invariant  procedures,  l.e.  those  based 
on  the  process  *a  ,  m,n  >  1  or  equivalently  on  ^  -  xJ-x1,  i  -  1,2,...  and 
Wj  •  Fj  i  *  .  Our  first  result  is  a  "separation"  theorem,  which  says  that 

la  a  certain  sense  the  problem  of  statistical  inference  shoot  8  cam  he  separated  free* 
the  problem  of  allocation,  provided  we  restrict  ourselves  to  invariant  procedures  (cf. 
Leama  1  of  RCbblna  and  Slegnund,  1973). 

It  is  convenient  to  introduce  the  following  notation t 

V.  *  wv  ‘i*>  v  • 


W(c)  *  Brownian  notion  with  drift  6  , 
3y(t)  •  «<«<•),  •  <  t)  , 

*  an/(n+a)  . 


n,n 


Proposition  1.  For  arbitrary  n,n  _>  1 


-»<'..»> I Vv.» 


Proof.  Staple  algebra  yield* 


(1) 


Vn,n  “  *a,o  *  *^1/ (■*•*■!>  -  n(I  y^  +  l  ^/(e+n)  (*♦««.) 


It  le  easy  to  see  that  the  two  terse  on  the  right  head  aide  of  (1)  are  each  uacorre- 
latad  with  u^,  1  <  a  aad  ,  J  <  a.  Hence  by  properties  of  the  aoraal  distribution 
*  * _ given  3.  _  Is  noraally  distributed  with  expectation 

■*i,n  Bpn 

nUj/  (aHt+1)  -  n(aw^  ♦  nPj)  /  (n+n)  (**n-*-l) 

-  n“4/ (afn)  (e+n+l)  »  dCt^^  -  t->B) 

aad  variance 

ta/(«Hr*-l)]2  +  n2/(a*n)(n*trt-l)2  -  t^^  -  t^  . 

But  this  is  precisely  the  condltloaal  distribution  of  iKt^  Q)  -  a)  given 
a^(t^  ).  A  similar  arguasnt  applies  to  a^^  -  s^. 

Corollary  1.  For  say  invariant  allocation  rule  the  processes 


{<«_  -  an  /(*♦«))  2  -  an/ (*♦»),  9  ) 

are  asrtlagales. 

Aa  taper  teat  case aquas so  of  Preposition  1  is  that  for  say  allooatiee  tale  based 
an  the  process  »B|  «r  speWalantly  an  tbs  n'a  and  o'o.  Chare  lists  aa  *faa>- 
asrphle"  allocation  tele  baaed  ea  ^aaah  Mat  the  ananases  el  pOn 


{*B  B,  ae/(n+n)}  and  {W(tB  B)f  tB  n>  have  tkt  hm  joint  distribution.  lorn  if 
0  <  tf  <  •  rariovw  olloeotlon  colon  rUU  Myweii  of  "oboorootlonn" 

0  <  t _ <  t>,  Which  differ  only  In  tbo  (rondon)  tlnoo  nt  which  tho  Irowhlon  path  in 

ohoorvod.  Because  tho  Brownian  paths  cro  continuous  ond  tho  laerenanta  t>(1  #  -  t^B 

or  t  - 1 _ €  (0,1) ,  tho  onoet  choieo  of  olloeotlon  rolo  has  o  United  effect 

on  tho  Joint  dlstrlhotlon  of  tho  observed  dots  provided  t  .♦t,  do  n+n  In 

■|B  X 

psrtlcolor.  If  tho  procees  (W(t  t  .  Is  observed  until  It  first  loaves  sons 
ration  with  o  continuous  boundary  In  the  space  tine  plane,  tho  point  at  which  the 
process  loaves  the  region  has  a  distribution  which  Is  approxiaately  Independent  of  tho 
allocation  rule. 

for  our  present  purposes  this  has  the  following  consequences.  As suns  touporarlly 
that  tho  allocation  rule  does  not  depend  on  the  data  —  Cor  esaupls  that  observations 
are  taken  in  pairs  1  ■  1,2,...  and  -  y£.  Assuue  also  that  In  this 

context  we  favor  a  particular  procoudra  for  asking  Inferences  about  <  -  ftf^  for 
example,  to  test  H^i  6-0  wo  stop  sapling  at  ain(T,2v),  where 

n 

T  -  inf  {ns  j£  w.|  >  2b) 

1  1  ~ 

T 

and  v  is  some  positive  integer.  If  T  <  2v  and  n±  >  2b  we  reject  HQ  and  say 

that  6  >  0;  if  T  <_  2v  end  I*  w^  <  -  2b  we  reject  HQ  and  say  that  6  <  0;  If 

T  >  2v  we  accept  HQ  aa  being  approximately  true.  Tho  power  function  of  this  test 

of  Hq:  6-0  against  6/0  la  P^{T  <  2v>  and  the  axpected  sample  slse  Is 

B.(T  A  2v) .  For  any  invariant  allocation  rule  there  axists  the  analogous  procedures 
0 

stop  sampling  whan  an/  (n+n)  >  v  or  at 

(M.N)  -  lnf{(n,n) :  |s  n|  >  b>  , 

whichever  occurs  first,  and  reject  H^t  6*0  if  and  only  if  8S/(fi+i)  £  V.  It 
follows  from  tho  raaarks  following  Proposition  1  that  the  power  function 
Pa{MM/(M  +  M)  <  v)  of  this  test  satisfies 

(2)  P6{iS/(ii+ii)  <  V)  S  ?4{t  <  2v)  , 
and 

(3)  2Eg{(fli/(ft+t)]  A  V)  *  tg(T  A  2v)  . 

Banco  we  have  obtained  a  sequential  toot  whose  power  function  Is  to  a  considerable 
extent  Independent  of  tho  alloeation  rule  usod,  and  wo  are  free  to  consider  different 
allocation  rules  la  aa  attaspt  to  alalniae  the  neahor  of  Bbssrvntloes  taken  on  the 
Inferior  troetaant. 
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lott  Out  although  wo  proeood  with  tho  discus  lion  (or  «m  portlcolor  wquatltl 
tost*  wo  could  equally  well  consider  others,  e.g.  a  repeated  significance  test.' 

Before  we  consider  in  detail  the  choice  of  allocation  rule,  it  is  helpful  to  ob¬ 
serve  the  following  linits  lnposod  by  (3) .  Let  X  and  B  denote  the  nmmhsr  of  s 
end  y  observations  respectively  when  sampling  stops,  so  BB/CM+B)  ■  (B/(i+i)l  A  v. 
glees  min<M,B)  >  MB/(M  +  B)  with  equality  if  end  only  if  nax<H,B)  -  ",  it  follows 
frae  (3)  that 

<*)  einttjM.EgB)  >  |  Bg(T  A  2v)  , 

end  e  necessary  condition  for  approximate  equality^  in  (4)  is  that  nax(BgK(KgB)  he 
extrenely  large.  Since  x(l-x)  <  1/4  with  equality  if  and  only  if  »■  1/2,  by  (3) 

(5)  +  >  4Kg{MB/(M  +  K)}  •  2Ig(T  A  2w) 

and  there  is  equality  in  (5)  if  and  only  if  M  and  K  are  approximately  equal  with 
probability  one.  Fron  (4)  and  (S)  we  conclude  that  the  axpected  nunber  of  observations 
on  the  inferior  treatment  is  at  least  1/2  as  large  as  pairwise  allocation  requires; 
end  any  deviation  fron  pairwise  allocation  results  in  sane  Increase  in  the  total  ex¬ 
pected  sample  size. 

The  iv.^jwing  argument  for  choosing  an  allocation  rule  is  due  to  Heyre  (1979) . 
Suppose  that  when  6  is  the  true  difference  in  mean  response,  the  cost  to  the  experi¬ 
menter  of  an  x  observation  is  g(6)  while  that  of  a  y  observation  is  h(d).  Bence 
the  total  expected  cost  of  sampling  is 

<«)  g(«)Bg(K>  ♦  h(«)B 4(B>  . 

The  overall  risk  function  is  the  sun  of  (6)  and  the  risk  associated  with  making  e 
wrong  terminal  decision.  But  since  the  power  function  of  our  test  is  essentially  in¬ 
dependant  of  the  allocation  rule  used,  we  can  ignore  the  terminal  decision  part  of  the 
risk  function  end  attempt  to  minimise  (9).  Since 

(7)  M  -  IMB/(I*  +  B)]<1  +  M/B)  -  IMS/(M  +  B)1(1  +  Q)  , 

•ay,  and 

(S)  B  -  [MB/  (M  +  B)  J  (1  +  Q”*)  , 

we  can  rewrite  (6)  as 

<»)  (h  +  g)Bg(lM/(M+B))  ♦  Bg{[MB/<X4.B))Cgtt+l*“1])  . 
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Moreover,  by  (3)  the  first  ten  la  (9)  ie  eooenf lolly  Independent  of  tin  el location 
rule,  ee  we  attest  to  minimise  the  eeeoad.  Calculus  ehowe  thet  for  every  Q 
«Q  +  Kf1  >  2(fh)1/2  with  equality  if  end  only  If 

(10)  Q  -  (h/g)1/2  . 

Bence  e  lower  bound  to  (9)  ie 

(11)  (h1/2  +  gl/2)2  B4tH«/0l+lll  , 

which  could  be  achieved  only  if  we  could  allocate  obeervatione  no  thet 

(12)  P4(S/M  -  [f(d)/h(d))1/2)  -  1  . 

Since  fi  ie  unknown  this  la  Impossible,  but  aa  an  appr oximat Ion  we  consider  the  allo¬ 
cation  rule  which  takes  the  next  observation  frow  the  y  population  if  and  only  if 

(13)  n/n  <  [*(5>-ya)/h(5a-yn)]1/2  . 

To  the  extent  that  this  allocation  rule  behaves  as  we  hope  it  will,  l.e.  to  the  extent 
that  (12)  is  approximately  true,  by  (7)  and  (8)  we  have  the  approximations 

(14)  Efi(M)  =  E6C*W/(M  +  ll)ni+(h/s)1/2J  . 

(15)  I6W  5  E6lMI/0H-B)Hl+(8/b)1/2]  , 

and  the  risk  (6)  is  approximately  the  lower  bound  (11). 

A  numerical  example  Illustrating  these  results  is  given  in  Table  1.  The  functions 
g  and  h  are  of  the  form 

j1 

(16)  $(&}  •  h(-6)  »  | 

l  1  +  d|«| 

This  choice  baa  the  interpretation  thet  the  basic  (experimental)  cost  of  aa  observation 
is  unity,  and  the  additional  (ethical)  coat  of  assigning  the  inferior  treatment  ie 
moportioaal  to  |6| .  For  comparison  the  first  row  in  each  cell  of  table  1  ie  for 
,<«lrviae  al locetlon,  aa d  the  computations  of  power  and  expected  eemple  else  use  the 
approximations  suggested  by  BUgaund  (1979)  aa d  shown  to  be  vary  accurate,  the  second 
rev  ef  each  cell  gives  results  for  the  ■■glieg  rule  (13)  with  g  end  h  Mimed  by 
(16).  The  first  entry  is  the  outcome  ef  a  400  repetition  Meats  Carlo  experiment,  and 


if  «  >  0 

if  «  <  0  . 
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the  parenthetical  entry  is  eh*  theoretical  approximation  given  by  (15) ,  (14) ,  or  (11) . 
Tbs  None*  Carlo  results  lend  support  to  our  informal  interpretation  of  Proposition  1 
to  tbs  offset  that  tbs  power  and  Kg[Mt/(M+K)]  are  approalnataly  independent  of  tbs 
allocation  rule,  and  they  indicate  that  tbs  ■pprmrlnsMons  (15),  (14),  and  (11)  are 
quite  good.  Hayre  (1979)  reached  the  sans  conclusions  for  a  different  stopping  role 
and  value  of  d  in. (16).  Most  Importantly  the  results  ghee  a  fairly  substantial  de¬ 
crease  in  risk  of  about  15-30X  when  the  allocation  rule  (13)  is  used. 

TABU  1 

First  row  in  each  cell  is  for  pairwise  allocation;  second  row  Is  for  allo¬ 
cation  rule  (13)  with  h  and  g  given  by  (16)  with  d  ■  20;  in  all  eases 
b  ”  10.8,  v  -  25;  theoretical  calculations  are  in  parentheses;  others  are 
Monte  Carlo 


6 

Power 

Efi(N) 

b6(m) 

2Bg[MB/0H*)) 

Bisk 

1.13 

(1.00) 

(19.9) 

(19.9) 

(490) 

1.00 

12.3  (12.0) 

53.7  (58.3) 

343  (341) 

.85 

(  .986) 

(26.4) 

(26.4) 

(26.4) 

(502) 

.995 

15.9  (16.9) 

62.7  (59.7) 

25.2 

349  (363) 

.57 

(36.8) 

(36.8) 

mam 

(493) 

24.0  (23.6) 

77.5  (83.2) 

375  (376) 

.28 

(46.7) 

(46.7) 

(46.7) 

(355) 

36.4  (32.5) 

77.4  (83.5) 

46.6 

318  (298) 

.00 

(  .050) 

|SBM| 

(49.5) 

.048 

49.6 

The  reduction  in  risk  of  15-30X  coapsred  to  pairwise  sanpling  in  Table  1  nairas 
the  allocation  rule  (13)  seen  attractive;  but  it  is  not  large  enough  to  overwhelm  cer¬ 
tain  disadvantages  without  further  investigation.  (By  way  of  comparison  a  fined  sample 
else  with  paired  observations  requires  48  pairs  to  achieve  about  the  earn*  power  func¬ 
tion  as  in  Table  1.  This  lesds  to  risks  of  1181  and  912  for  8  ■  1.13  and  .85,  so 
sequential  sanpling  with  pairwise  allocation  lesds  te  a  reduction  in  risk  far  large 
|d|  of  about  501  coopered  to  a  fixed  seupls.)  Me  disadvantages  Include  (1)  She  Sant 
that  the  allocation  rule  (13)  is  uou  rsndonirsd,  (ii)  qussrlenahle  performance  when 
the  patient  population  la  stratified,  (ill)  difficulty  in  Inplsnaatstiaii  II  «ha  data 
are  sa—laod  occasionally ,  but  not  acacias  sooty,  sad  <iv)  qaastlsashlc  parfquasaea  for 


tacMM  available  on  old  ones.  Accoamodating  these  dlfflcultlaa  Undo  to  nm  daterlo- 
ration  in  the  performance  of  adaptive  allocation  rules,  which  nay  lead  to  questioning 
their  desirability  at  all.  Bare  we  diacuac  (1)  and  (il)  oy  naana  of  a  Monte  Carlo 
anparinant. 

The  advantagea  of  randomisation  in  clinical  trials  has  bean  discussed  at  great 
length-prlnarily  in  an  effort  to  eliainate  aalaction  bias  (a.g.  Blackwell  and  Bodges, 
1957),  hut  secondarily  to  provide  the  possibility  of  a  permutation  teat  of  the  hypoth- 
asla  of  no  treatment  affect.  It  is  easy  to  define  a  randomised  version  of  (13)  to  cut 
down  on  aalaction  bias.  For  example,  we  might  select  treatment  B  or  treatment  A  with 
relative  probabilities  given  by  the  right  hand  side  of  (13).  Mora  precisely,  let 

Xm,n*  I*^m-?B)/h<;.‘5n)ll/2 

and  take  the  next  observation  from  the  y  population  if  and  only  if 


(17) 


Umt*l  1  \ 


/  (1  +  X  ) 

>|D  Bfll 


» 


where  U1(02',...  la  an  auxiliary  sequence  of  independent  uniform  random  variables  which 
we  generate.  Asymptotically  this  rule  generates  the  appropriate  relative  frequencies 
of  treatment  selections.  A  more  sophiatlcatad  version  would  be  one  which  takas  account 
of  how  far  n/m  Is  from  the  desired  ratio  of  X _ in  selecting  the  next  treatment. 

t&pTl 

For  g  and  h  given  by  (16)  with  d  -  20,  and  for  6  in  the  range  1-1,1).  the 
right  hand  side  of  (17)  is  in  the  range  (.1,.9)  with  high  probability,  so  there  is 
always  some  Indeterminacy  in  the  next  treatment  assignment. 


TABU  2 

Randomised  Allocation  (17) 


b  »  10.8,  v  * 

25.  g 

end  h 

given  by  (16)  qtth 

d  -  20 

6 

Power 

e5(h> 

*«<**) 

2E  [MN/ OH*)] 

Bisk 

1.13 

1.00 

12.7 

50.3 

19.5 

350 

.85 

.995 

18.2 

60.3 

26.8 

388 

.57 

.793 

26.6 

72.4 

37.0 

402 

.28 

.315 

38.8 

72.0 

46.0 

328 

Table  2  gives  the  outcome  of  a  400  replication  Monte  Carlo  experiment  being  the 
randomised  allocation  rule  (17).  By  comparison  with  Table  1  we  see  that  randomisation 
baa  led  consistently  to  an  increase  in  risk,  but  one  so  slight  that  the  benefits  of 
randomisation  seem  tt  outweigh  the  liability. 
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Th«  question  of  stratification  ia  more  complicated  because  the  results  mar  depend 
on  the  nuaber  and  relative  sixes  of  different  strata.  The  difficulties  are  most  acute 
with  a  large  nuaber  of  snail  strata,  where  one  usually  wants  to  guarantee  a  certain 
aaount  of  balance  in  the  sample  from  each  stratum,  ao  that  a  stratum  could  be  analysed 
by  itself  if  the  model  relating  different  strata  seems  to  be  Inappropriate. 

To  be  specific  suppose  there  are  r  strata  and  for  k  -  1,2,..., r,  in  stratum 
k  the  response  of,  the  itk  patient  on  treatment  A  is  x^,  which  is  distributed 

and  that  of  th*  jth  P*tient  on  treatment  B  is  yfc^,  distributed  nfti^l). 
After  m^  assignment*  of  treatment  A  and  n^  of  treatment  1  in  the  kth  stratum,  the 
maximum  likelihood  estimator  of  the  treatment  effect  6  is  (in  the.  obvious  notation) 


(18) 


£(m,n)  - 


r  Vk  - 

k-1  ak  +  nk  <Xk*"k"yk*nk> 


r  Vfc 

k.i\+ak 


Let  s(m,n)  denote  the  numerator  and  t(a,n)  the  denominator  of  6 (a ,  n) . 

It  is  easy  to  obtain  a  result  analogous  to  Proposition  1,  and  hence  to  conclude 

that  s(m,n)  behaves  like  Brownian  motion  with  drift  6  in  the  time  scale  of  t(m,n) 

provided  that  an  invariant  treatment  allocation  rule  is  used.  Here  Invariant  means 

that  the  choice  of  the  next  treatment  asalgnment  stay  depend  only  on  the  vector  of 

differences  (x,  ~y,  . x  -y  ).  Hence  as  above  we  can  test  6  »  0  with  a 

•L,*l  r.my  r,^ 

test  whose  power  function  is  essentially  independent  of  the  (invariant)  allocation  rule 
uaed,  and  we  can  turn  our  attention  to  the  cost  of  sampling. 

In  analogy  with  (6)  suppose  the  expected  cost  of  sampling  is  given  by 

(19)  S(6)£B(k  +  h(6)EESk  , 

where  (Nfc)  is  the  nuaber  of  x'a  (y's)  observed  in  the  kth  stratum,  k«l,2,...,r. 
The  argument  leading  to  (11)  now  gives  as  a  lower  bound  to  (19) 

(20)  (h1/2  +  g1/2)2K4I  I  W^+V1 

k“l 

and  there  is  equality  between  (19)  and  (20)  if  and  only  if  (cf.  (12)) 

(21)  -  [g(6)/h(6)]1/2)  -  1  for  all  k  -  l,...,r  . 

This  suggests  in  analogy  with  (13)  that  If  a  new  patient  arrives  and  falls  into  stratum 
k,  then  he  is  assigned  treatment  B  if  and  only  if 

Vs  <  l»(*(a»a»/M*(a.a»l1/2 


(22) 


1 


where  6  1*  given  in  (18). 

However,  there  ie  an  additional  practical  conaideration,  which  in  especially  la- 
portent  when  there  ere  small  strata'.  The  aodsl  of  fixed  treatment  effect  across  strata 
is  somewhat  tentative  and  usually  must  be  cheeked.  To  do  this  requires  a 
amount  of  balance  in  the  aesignaent  of  treataents  in  each  stratum  individually.  Bence 
we  modify  the  sampling  rule  (22)  by  choosing  some  small  positive  number  vQf  sad  use 

(22)  only  if  *|tn|t/(ag+n|[)  —  v0‘  H  "knk^*k4‘,lk^  <  v0*  **  ***•  treatment 

assignment  in  some  way  that  provides  for  about  half  of  the  first  4Vq  patients  to  re¬ 
ceive  one  treatment  and  half  the  other.  Of  course,  this  effects  our  ability  to  approx¬ 
imate  (21),  especially  in  small  strata  where  the  threshold  Vq  may  not  be  exceeded; 
but  it  avoids  the  disastrous  situation  where  almost  all  assignments  in  a  small  stratum 
are  to  one  treatment. 

Table  3  reports  the  results  of  a  Monte  Carlo  experiment  to  determine  the  effects 
of  stratification  together  with  randomization.  The  test  is  defined  by  the  same  param¬ 
eters  as  those  in  Tables  1  and  2,  and  hence  has  essentially  the  same  power  function. 
There  are  four  strata  in  the  relative  sizes  4:3:2:1.  The  threshold  is  Vq  -  3,  and 
strict  pairwise  sampling  is  used  in  each  stratum  until  this  threshold  is  reached. 
Thereafter  a  randomized  version  of  (21)  as  specified  in  (17)  Is  used. 

The  results  are  more  ambiguous  than  in  Table  2.  For  large  |6|  stratification 
substantially  increases  the  risk  to  the  extent  that  sequential  data  dependent  allo¬ 
cation  seems  only  slightly  better  than  pairwise  sampling.  For  small  |6|  there  is  a 
comparatively  insignificant  Increase  in  risk.  Although  these  results  are  not  sur¬ 
prising  qualitatively,  and  therefore  probebly  persist  to  some  extent  under  different 

TABLE  3 

Stratified  Date,  Randomized  Allocation 


b  * 

10.8,  vQ  -  3, 

-  25,  d  -  20 

6 

Power 

*  W 

[W 

2 1  ww 

Risk 

1.13 

1.00 

17.6 

23.8 

19.8 

439 

.83 

.990 

22.3 

35.1 

26.6 

449 

.57 

.848 

29.2 

47.8 

35.2 

409 

.28 

.288 

40.3 

61.1 

46.9 

327 

experimental  conditions,  the  exact  magnitude  of  the  changes  may  well  be  sensitive  to 
the  number  and  size  of  the  strata,  the  parameters  b,  vQ,  v,  etc. 

A  conclusion  to  be  drawn  from  Tables  2  end  3  is  that  practical  constraints  on 
using  mi  allocation  rule  like  (13)  may  reduce  the  advantage  over  pairwise  allocation 
exhibited  in  Table  1,  and  suggest  that  some  study  of  those  constraints  relevant  to  a 

9 


particular  problem  should  probably  ba  made  before  seriously  contemplating  use  of  a 
sequential  allocation  scheme. 

Remarks  (1).  It  seems  to  be  an  interesting  mathematical  problem  to  explain  the  success 
exhibited  in  Table  1  for  the  approximations  (14)  and  (15).  Heuristic  arguments  lndl- 

i 

cate  that  these  approximations  should  ba  valid  to  within  0(1)  as  b  «®,  v  ♦  », 
and  bv  ^  -*■  const.  But  proving  this  result  or,  what  is  more  Interesting,  determining 
the  constant  implicit  in  the  0(1)  may  be  rather  difficult. 

(11)  A  challenging  problem  is  to  extend  Proposition  1  and  its  consequences  to  other 
situations.  An  Interesting  discussion  by  Jennison,  Johnstone,  and  Turnbull  (1981) 
shows  that  the  naive  generalisation  to  three  populations  is  not  valid. 
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